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® A semiconductor device capable of realizing a neuro-computer chip of high integration degree and low 
power consumption. The device consumes a very small amount of electric power and the combinations of 
synapes can be realized, using a small number of elements. A first MOS type transistor includes a first gate 
electrode floating in potential and provided in a region isolating a source region from a drain region via a first, 
insulation film, and plural second gate electrodes eapacitively coupled to the first gate electrode via a second 
insulation film, one of which is in connection with a source electrode. The gate or drain electrode of the MOS 
type transistor is in connection with a first wiring for transferring signals of high. or low level in potential. 
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Technical Field 

The present invention relates to a semiconductor device, and more particularly a highly functional 
semiconductor integrated circuit to realize a neural network computer or a neuron computer. 

s . * ■ ■ ' . . . . . ' " • ■ " 

Background Art 

A semiconductor integrated circuit technology has rapidly progressed. For example, in the case of 
dynamic memory, memory chips with a capacity of 4 though 16 Mbit have been already put into mass 

10 production and ultra high integration memory chips with 64 Mbit are now being developed, in which about 
120 million MOS transistors are integrated on a silicon chip with an area of 1 cm 2 . Such an ultra high 
integration technology is applied to a logic circuit as well as a memory circuit, and a variety of functional 
logic circuits represented by 32 bit CPU or 64 bit CPU are also under development 

In these logic circuits, arithmetic operation is carried out by using digital signals, i.e., binary signals 

is composed of 1 and 0. For example, a Neumann method is adopted for a computer, where commands are. 
executed one by one according to a program. Simple numerical calculations can be done at very high 
speed by this method; however, it takes enormous long time to implement the pattern recognition or image 
processing. Furthermore, this method is not suitable for information processing such as association of ideas 
and learning. In spite of a lot of research and development activities to dear with these information 

20 processing using software technology, remarkable results have not been produced yet. 

There has been another stream of research to get rid of. these difficulties at once and then to construct 
a computer which imitates the arithmetic operations of the brain, i.e., neuron computer by studying the 
function of brain. This kind of research began in 1940s and becomes very active in last several years since 
the progress in LSI technology may has suggested the possibility to realize the hardware of a neuron 

25 computer. 

However, the present semiconductor LSI technology still has so many problems that the prospect for 
practical application is still far from certain. 

Technical problems in fabricating an LSI chip of neuron computer with the current LSI technology are 
described in the following. 

30 In. spite of complicated structure and high function, the brain is made of very simple basic unit, which 
consists of a nerve cell called neuron performing arithmetic operation and a nerve fiber acting as an 
interconnect to transmit the result of arithmetic operation to other neurons. 

The unit of brain is simplified and then described in Fig. 9. In the- figure, 901a, 901b and 901c are 
neurons. 902a, 902b and 902c are nerve fibers. 903a, 903b and 903c are called as synapse couplings. For 
. 35 example, a signal transmitted thorough nerve fiber 902a is multiplied by weight W a at synapse coupling 
903a and the weighted signal is inputted to neuron 901a. Neuron 901 sums up inputted signals and is 
activated to output signal (namely, the neuron gets fired) when the sum is larger than a threshold value. On 
the other hand, the neuron outputs no signal when the sum is less than the threshold value. 

Such phenomena as arithmetic operation, transmission of signal, and weight multiplication are carried 

40 out electrochemically in a real brain, and signals are transferred and processed as electric signal. The 
learning process of human is correlated to the change in weights of synapse couplings. The weight is 
gradually modified to the optimum value to have correct output for various combinations of inputted signals. 
In other words, the knowledge is stored in the brain as weights of synapse couplings. 

A number of neurons are mutually connected, forming a layer and it is known that six layers are 

45 stacked in the human brain. In realizing a neuron computer, it is the most important matter to construct LSI 
system with above-mentioned structure and function. 

Fig. 10 is a schematic representation illustrating the function of a nerve cell, i.e., neuron, which was 
proposed by McCumllock and Pitts as a mathematical model of neuron ( Bull. Math. Biophys., Vol.5, p. 115 
(1943)). At present, the studies, are being carried out actively to construct a neuron computer by realizing 

so this model with semiconductor circuits. Vi , V 2 , V 3 r, V n are n input signals defined as, for example, 
magnitudes of voltages, and correspond to signals transferred from another neurons. W,, W 2 , W 3 , W n 
are coefficients representing the coupling strength between neurons, and are biologically called synapse 
coupling. The function of this neuron is that when the value 2, the linear sum of products of input Vi and 
respective weight Wj ( i = 1 - n )', becomes larger than a predetermined threshold value Vth*, the neuron 

55 outputs 1; on the other hand, 0 when Z is less than Vjh*. The numerical expression is given as follows: 
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Z = 2 WiVj 

5 . ' . . ' . - - ■ ... • 

1 ( Z > Vxh") 

70 - 0 ( Z < V T „~) 

Fig. 10(b) shows the relationship Between Z and V out . The output is 1 when Z. is large enough as 
compared with V™*, and 0 when Z is large enough 
,75 In order to construct the neuron using conventional transistors, a large number of transistors are 

required. Furthermore, since the sum operation is carried out after signals are converted to electric current, 
a large amount of current flows, resulting in large power dissipation. This means the integration of neurons, 
is substantially impossible. 

However,. this problem has been overcome by the invention of Neuron MOSFET ( fMOS ) made by the 
20 present inventors ( Japanese Patent Application Heil-141463). This invention is epoch-making such that the 
principal function of a neuron is attained using single transistor and that little power js dissipated because 
the sum operation is carried out on the basis of voltage mode. Fig. 11(a) shows a cross-sectional diagram 
of eMOS, where 1.101 is. e.g.. a P-type silicon substrate, 1102 and 1103 are source and drain formed with 
N + . diffusion layer. 1104 is a gate insulating film such as Si O2 film formed on a channel region, 1106 is a 
25 floating gate electrically isolated, 1107 is, e.g., an insulating film such as S»02 and 1108 (G1 . G2, G3.G4) 
are input gates which correspond, to the input part of neuron. 

Fig. 11(b) is a simplified diagram to explain the performance of neuron. Let capacitive coupling 
coefficient between each input gate and the floating gate be C G and that between the floating gate and the 
silicon substrate be Co.leading to floating gate potential Z as: 
30 . .. • . • • •'• 

Z = -W ( V t + V 2 + V 3 + V* ) (4) ; _ 

W = C G / ( C 0 + 4 C G ) ■ (5) 

35 Here, Vi, V 2 , V 3 and V* are voltages inputted to input gates G1, G2.-C3.and G4, respectively and the 
potential of silicon substrate is 0 V; that is, the substrate is grounded. . . 

The vMOS is regarded as an ordinary N-channel MOS transistor with the floating gate acting as a gate 
electrode. A threshold voltage seen from the floating gate ( at which an inversion layer is formed, on the 
substrate surface ) is expressed by Vth*. Accordingly, ? MOS turns on When Z > Vjh*. and turns bff .when Z 

40 < V TH *- Therefore, the combination of fMOS 1109 and single inverter as shown in Fig. 11(c) makes it 
possible to attain the function of a neuron. 1110 and 111.1 denote resistors to construct an inverter; 1112 
denotes an NMOS transistor. Fig. 11(d) represents V 0 uti and V 0UT2 as a function of Z. V 0U T2 becomes the 
high voltage level of V DD for Z > V TH *; the state where the neuron gets fired is realized. 

As is shown in Eq, 4, the basic performance of a neuron is that the sum of input signals to a neuron is 

45 calculated in the voltage mode, and the neuron gets fired when the sum exceeds Vth* is realized by single 
eMOS. Because of the sum calculation in the voltage mode, the current at input stage flows only to charge 
or discharge the capacitances and therefore the amount of current is very little. On the other hand, direct 
current flows through the inverter when the neuron gets fired since resistor 1110 is used as a load. By using 
a fMOS gate of CMOS configuration shown in the previous invention ( Japanese Patent Application Heil- 

50 141463), the direct current can be prevented. 

Fig. 12 is an example of CMOS configuration. Fig. 12(a) represents a cross-sectional diagram of the 
CMOS neuron gate, where 1210 denotes a P-type. silicon substrate, 1.202, N-type..well, 1203a and 1203b, 
N + -type, source and drain, respectively, 1204a and 1204b, N + -.type source and drain, respectively, 1205, a 
floating gate, 1206a- I206di insulating films such as Si02, : and 1209, a field oxide film. 

55 Fig. 12(b) represents an example of single neuron circuit configuration, where 1210 is the symbol of the 
CMOS gate which is shown in Fig. 12(a). The same numerals as . in Fig. 12(a) are used for the 
corresponding parts. 1211 denotes a CMOS inverter, .1212 and 1213, NMOS and PMOS, respectively, and 
1214, the output of the neuron. As mentioned, a neuron can be constructed with a small number of 
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elements and power dissipation is very little, indicating that *MOS is inevitable in realizing a neuron 
computer. - 

In addition to a neuron, another important element, a synapse, is required to realize a neuron computer. 
Fig. 13 represents a basic configuration of a conventional neuron circuit which contains synapse couplings 
5 together with a fMOS transistor. 1301 is, a neuron circuit as shown in e.g. Fig. 11(c). 1302 is an 
interconnect through which the output of another neuron is transferred. 1303 is a synapse circuit to put 
weight on signal, consisting of a source follower circuit where source 1306 of NMOS transistor 1304 is 
connected to resistors ( R + R x ). Therefore, when the output voltage V s of fired neuron is applied to the 
gate electrode 1305 of NMOS transistor 1304, the potential of source 1306 becomes V s - V TH where V™ is 
.. io. a threshold voltage of NMOS transistor 1304. 

For the case of V™ 0, the potential of source 1306 is V s . The voltage is divided by two resistors R . 
and R x to be the output of the synapse circuit which is. transferred to neuron 1301 through interconnect 
1307. The output voltage is expressed by V s R x /( R + R x ), showing that the signal voltage V s is multiplied 
by weight R x /( R + Ri x ) and that the weight can. be changed by R X: 
15 '■ Fig. 14(a) represents a method to obtain a variable resistor. For example, with the application of : 
constant voltage V GG to the gate, of MOS transistor 1401, the transistor act as a resistor. Therefore, the 
resistance can varies with the value of V GG . 

Fig. 14(b) represents an example of circuits to control the value of V GG which consists of a binary 
counter 1402 and a D/A converter 1 403. The coupling strength of synapse is expressed by 4-bit binary 
20 number which is to be converted to analogue voltage by D/A converter 1403 and outputted as V GG ..ln order 
to strengthen the synapse coupling, the value of V GG is increased by ascending the value of the counter and 
the vaiue is decreased by descending the value of the counter: 

Next, the problems of the synapse circuit shown in Figs. 13 and 14 are extracted. , 

The first problem is that the generation of weight is made by using voltage division in Fig: 13. Since the 
25 current always flows through the resistors in this method to hold the weighted output voltage, the power of 
(R + R x )* V s 2 /2 is always dissipated. Even if the power dissipation at neuron 1302 is reduced by the use of 
j'MOS, the whole power dissipation of the circuit will not be reduced enough. For the case of two-layer 
neural network, each of which has n neurons, the number of synapse couplings is n 2 ; the number of 
synapse couplings is much larger than that of neurons. Therefore, it is impossible because of too much 
30 power dissipation to design a neural network for practical use with the synapse coupling circuits which 
require stationary flow of current 

The second problem is that high integration of the circuit which determines the weight of the coupling is 
impossible to be realized because the circuit shown in Fig. 14(b) requires a large number of elements. For 
the neural network having the learning function, the strength of each synapse coupling is required to be 
35 suitably changed and memorized. A 4-bit binary counter, in Fig. 14(b) is used for this purpose, but at least 
30 transistors are necessary for the counter. A. large number of elements are also necessary for 
constructing a D/A converter. Furthermore, these circuits dissipate more power per synapse coupling and 
thus are disadvantageous in terms of power dissipation. 

In short, conventional technology cannot actually provide a neural network of low power dissipation and 
40 high integration. It is impossible to realize a neuron computer using prior art technology. 

The present invention is made to overcome these problems. The. aim of the invention is to provide a 
semiconductor device which can construct synapse coupling dissipating very little power using a small 
number of elements. and to realize a low power dissipation, highly integrated neuron computer chip. 

45 Disclosure of the Invention 

A semiconductor device of the present invention comprises a first semiconductor region on a substrate, 
first source and first drain regions of opposite conductivity type to that of said first semiconductor region 
formed in the said first semiconductor region, a first gate electrode floating in potential formed over the 
so region separating said first source and first drain regions through a first insulating film, a plurality of second 
gate electrodes capacitlvely coupled with said first electrode through a second insulating film, and a first 
MOS type transistor, wherein the source electrode of said first MOS type transistor is connected to one of 
said second gate electrodes and at least the gate or the drain electrode is connected to a first interconnect 
which transfers two-level voltage signal of high or low level. 
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(Operation) 

By the semiconductor device of the present invention, which dissipates very little power and makes it 
possible to construct a synapse coupling with a small number of elements,, the high integration and low 
5 power dissipation of neural network system becomes possible. As a result, a neuron computer chip is 
realized for the first time at practical use level. 

Brief Description of the Drawings 

io Fig. 1(a) is a circuit diagram representing embodiment 1. Fig. 1(b) is a circuit diagram of a synapse 
coupling circuit 104 shown in Fig. 1(a). Figs. 1(c) and 1(d) are graphs showing the relationships between i n 
. and V gs n , and between i p and V gs p , respectively. Fig. 1 (e) a graph showing V oul as a function of V in from 0 V 
_ to V D0 . . ' ; ' 

. Fig, 2(a) shows a schematic diagram of embodiment 2. Fig. 2(b) is a cross-sectional view along XOO 
75 line of Fig! 2(a). Fig. 2(c) is a schematic diagram of the semiconductor device having synapses and a 
neuron where the neuron is expressed by the symbol. Fig. 2(d) is a circuit diagram showing principal part of 
the synapse; i.e. NMOS having a floating gate. Fig. 2(e) is a circuit diagram where the synapse couplings 
shown in Fig. 2(d) are arranged in matrix configuration. Fig. 2(f) shows a cross-sectional view of a non- 
volatile memory element with ferroelectric film. 
20 Fig. 3(a) is a graph showing the characteristic of depletion type PMOSFET. Figs! 3(b) and 3(c) are 
graphs showing the time-response characteristics of the circuit shown in Fig. 1(b). Fig. 3(d) shows another 
example of this invention. Figs. 3(e) - 3(g) show other examples of circuits.. . 

Fig. 4(a) is a circuit diagram explaining embodiment 3. Fig. 4(b) is a schematic , diagram of the synapse 
coupling shown in Fig. 4(a). 

25 Fig. 5(a) shows an example of layout of neural network which consists of single synapse coupling and 
single neuron 502. Fig. 5(b) explains materials used in Fig. 5(a). 

Figs. 5(c) and 5(d) are cross-sectional views along X-X f and Y-Y' lines of Fig. 5(a), respectively. 
. Fig. 6(a) is a circuit diagram of embodiment 5. Rg. 6(b) is a simplified diagram of Fig. 6(a). 
Fig. 7(a) is a diagram of 4-layer neural network represented by using the notations of Fig. 6(b), which 
30 explains embodiment 6. Fig. 7(b) shows l(n) part of Fig. 7(a). 

Fig. 8(a) is a circuit diagram explaining embodiment 7. Rg. 8(b) is a graph showing the relationship 
between V in and V out in Fig. 8(a). 

Fig. 9 is a schematic diagram explaining the fundamental unit structure of a cerebral nerve cell. 

Fig. 10(a) is a schematic diagram explaining the function of single neuron. Fig. 10(b) is a graph showing 

35. the relationship between Z and V 0 ut- 

Fig. 11(a) is a cross-sectionar view of fMOS. Fig. 11(b) is a schematic diagram explaining the operation 
of *MOS in Fig. 11(a). Fig. 11(c) is a circuit diagram of inverter using *MOS shown in Rg. 11(a). Rg. 11(d) 
is a graph showing V ou ti and V OUT2 in Fig. 1 1(c) as a function of Z. 

Fig. 12(a) is a cross-sectional diagram of CMOS neuron gate. Fig. 12(b) is a diagram showing single 
40 neuron circuit. 

Fig. 13 is a circuit diagram showing the fundamental unit structure of a prior art neuron circuit having 
synapse couplings constructed using an MOS transistor. 

Fig. 14(a) is a circuit diagram explaining a prior art method for realizing a variable resistor, Fig. 14(b) is 
a diagram of a circuit controlling V GG of Fig. 14 (a). 
45 ' ■ . 

Best mode for carrying out the Invention 

(Embodiment 1) 

so The first embodiment is explained by referring to Rg. 1. Fig. 1(a) is a circuit diagram of embodiment 1, 
where 101 denotes a neuron circuit as shown in e.g. Fig. 11 or 12. In terms of less power dissipation, the 
circuit of Rg. 12 is preferable. 102a - I02d denote input terminals of the neuron circuit, corresponding to 
e.g. 1206a - I206d of the circuit of Fig. 12. 103 denotes an interconnect which transfers the output signal of 
a neuron and hold the potential of V DD or OV depending on whether the neuron is fired or not. 104 is a 

55 circuit which act as a synapse, connecting the output 103 of the neuron and the input 102a of neuron 101. 
105 denotes an NMOS transistor. 106a and 106b are source and drain of the NMOS transistor, respectively! 
107, 108a and 108b denotes a PMOS transistor, its source and drain i respectively. The source electrode 
106a, 108a of NMOS and PMOS are connected to one 112a of input terminals of the neuron. The drains 
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106b, 118b of NMOS and PMOS are. respectively connected to V DD and the ground. The gate electrodes 
109, 110 of NMOS and PMOS are connected to interconnect 103. A capacitor C 111 is not an element that 
is installed, but a capacitance accompanying input terminal 102, such as incidental capacitance. 

In order to explain the operation , of this circuit, only/synapse circuit 104 is shown in Fig. 1(b), The 
s voltages between the gate and source V gs n , V gs p of and currents i n , i p fiowingthrough NMOS and PMOS are 
defined as shown in Fig. 1 (b), leading. to the relationships i n - V gs n and J p - V gs p shown in Figs. 1 <c) and 1 (d), 
respectively. NMOS is. an enhancement type (V™" > 0), and the threshold Vth p of. PMOS is set at nearly 0 
V. ' • . . ' •. • • • • " ■' " 

When V jn in the circuit of Fig. 1(b) is changed from 0 V to V DD , V out varies as shown in Fig. 1(e). In the 
io case of V in = 0 V and V out > 0, V gs p < 0. Then, PMOS transistor 107 is on and the capacitor C continues to 
discharge till V ou , = 0. In this case, NMOS transistor. 105 is off since V gs n = 0. 

When V in is gradually increased and V in . > V-m", NMOS transistor turns on and current i n flows, which 
charges up the capacitor C and increases V oul . V out is given by: 

is V out = V in - V TH n (6) 

In this case, transistor 107 is off and no current flows (i p = 0) since the. positive bias of. V gs p = V TH n is 
always applied to the gate of PMOS. Namely, the level of can be maintained without any direct current 
in this synapse circuit. When the neuron at the previous stage is not fired (V in = 0), the voltage of 0 V (V out 
20 = 0 V) is inputted to the neuron 101 at the next stage. When the preceding neuron is fired, the voltage 
determined by Eq. (6) is inputted to the following neuron. ■■ , 

For V in = V 00 , Eq. (6) is revised as: 

Vout = V o0 ( 1 - Vth Woo) 

25 ■ ■ ' ; ' \ ; • • . • .. ' " ' V ' - ' .■ 

and the weight used at the synapse is given by; 

W = ( 1 - V TH n A/ DD ) . (7) 

30 Namely, the weight W can be determined by the threshold V™" of NMOS transistor 105. 

Thus, by setting each threshold value of NMOS at appropriate value, a neural network with fixed values 

of synapse couplings is realized. In order that each NMOS transistor has a different threshold value; the 

amount of impurity such as B, P or As ion implanted into the channel part should be individually controlled 

for each NMOS transistor during manufacturing process; for example, the prescribed amount of ion is 
35 bombarded on the channel with the aid of the focused ion beam technology (FIB). The neural network thus ; 

obtained has no learning function, but can deal with specific problems such as a circulating salesman 

problem at very high speed. 

The neural network of this embodiment has such remarkable feature that only charging and discharging 

currents flow in the synapse couplings and therefore the power dissipation can be almost disregarded as 
40 compared with a prior art synapse coupling of resistance division type (Fig. 13). This network is also 

characterized by that the synapse is suitable for high integration because of being constructed with only two 

transistors and small occupied area on the chip. 

In the prior art circuit (Fig: 13), the potential of interconnect 103 is changed from 0 V to V DD and the 

capacitor C is charged up through NMOS transistor 1304 and resistor R. On the other hand, the charge up 
45 of the capacitor is made through only the NMOS transistor 105 in this embodiment, indicating that the 

operation speed can be increased as a result of decrease in effective resistance. 

The drain 106b of NMOS transistor 105 which is connected to V DD in Fig. 1(a) can be connected to the 

signal line 103 as well. In this case, the output of a neuron circuit at the previous stage should have large 

capacity to supply current, since the signal line 113 is also required to supply current to charge up the 
so capacitor C. That is, no power supply line to supply V DD to each synapse is necessary, which results in the . 

decrease of the number of interconnects. 

(Embodiment 2) 

55 The second embodiment of the. present invention is shown in Fig. 2. The strength of synapse couplings . 

can be changed by this embodiment and therefore a neural network having learning function can be 
realized. '■*:.'*■• 
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Fig. 2(a) is a schematic plan view and Fig. 2(b) is a cross-sectional view along X-X! line of Fig. 2(a). 
201,. 202 denote NMOS and PMOS transistor, respectively. 203 denotes, a floating gate made of e.g..N + - , 
type polysilieon film and formed on the channel region of NMOS through a gate insulating film 204 of e.g. 
200 A thick. The floating gate 203 opposes to N + region 206 which acts as a charge injection electrode, 

. 5 holding Si02 film 205 of e.g. 50 - 70 A thick between 207 is the gate electrode of PMOS transistor and 
capacitively coupled with the floating gate of NMOS transistor through e.g. a 200 A thick Si02 film 208 and 
. also act as a gate electrode of NMOS transistor 201. The electrode 207 is made of e.g. NMype polysilieon 
and connected to interconnect 210 made of e.g. Al through contact-hole 209. The A! interconnect is 
connected to the output of neuron circuit shown in e.g. Fig. 11 or 12. 

70 21 1 is an electrode made of e.g. WSi 2 and capacitively coupled with floating gate 203 through Si02 film 
212 of 200 A thick. 213a, 214a are sources of NMOS. and PMOS, respectively, and connected to one of the 
input terminals of the neuron at the next stage. 213b, 214b are the drains of NMOS and PMOS, : 
respectively, and connected to a power supply line V DD and a ground line (Vs S ), respectively. 

In Fig. 2(a), V 0D , V ss and the interconnects to the neuron at the next stage are omitted to avoid 

75 undesirable complexity.. In Fig: 2(b), 215, 216 denote a field oxide film and e.g: a P-type silicon substrate, 
respectively. Fig. 2(c) represents a semiconductor device having a synapse and a neuron by using symbol. 
In these figure, the same parts are indicated by the same numbers. 217 and 218a-218d denote a neuron 
circuit and its input terminals, corresponding to 101 and 102a-102d in Fig. Irrespectively. ' : 
As is clear from the comparison between Figs. 2(c) and 1(a), a synapse coupling is constructed by 

20 connecting NMOS and PMOS in series in this embodiment as. well as the embodiment 1 except that NMOS 
has floating gate 203. During the regular operation where the potential of electrodes 211, 206 is set at 0 V . 
NMOS transistor 201 operates in.the same manner as described in . the embodiment i; that is, NMOS 
transistor acts as an enhancement type transistor which turns on when the voltage higher than V-m" is 
applied to gate electrode 207. When the potential of signal line 210 becomes V DD and 0 V, V DD -V-rH n and .O 

25 V are inputted to 218a, respectively. 

■ .- In order to explain in detail the performance of. NMOS transistor having a floating gate, the correspond- 

. ing part is taken and shown in Fig, 2(d) using symbol; The same numbers show the same parts in Figs. 2(a) 
- 2(d), 207, 211, 206, and 203 are a gate electrode (hereinafter abbreviated as G), a control gate to control 
the synapse strength (W), a charge injection electrode (C) and a floating gate (FG), respectively. 

30 The potential Z of floating gate FG is given by 

Z > (C G V G + C w Vw + C C V C + Qf)/(C ox +;C c + C w + C G ) (8) 

Here, Q F is the amount of charges in the floating gate. V G , V w and V c are the potential of electrodes G. W 
as and C, respectively. Cox. Cc, Cw and C G are capacitive coupling coefficients between respective electrode 
and F G as defined in Fig. 2(d).. The potential of the P-type silicon substrate is set to be 0 V. 
As mentioned above, for V w = 0 and V c = 0, Eq. (8) is reduced to 

Z = ( C G V G + Q F )/C T OT . .. 
40 Ctot = C 0 x + C c + C w + C G (9) 

The threshold voltage of NMOS transistor seen from FG, (i.e. the minimum value of FG potential which can 
cause NMOS to form channel) is defined as.V TH *. Then NMOS turns on: if . 

45 (C G V G + QfVCtot > Vth - / ' .' 

or . ' . • • . . 

V G > (Ctot/C g )Vth" - Qf/C g . 

so . • . : ... • ' . ' .' •• ; 

In other words, the threshold voltage V TH n seen from gate electrode 207 is given by: . 

V-m n = (CtoVC g )Vth- - Qf/C g (10) : 

55 Ctot. C g , and Vjh* cannot be changed after the device is constructed because those values are determined 
by device structure and manufacturing process. - However, Vth" can be changed by modifying the value of 
Q F and therefor the weight of synapse coupling is changed according to Eq. 7. . 
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Although both V w and V c has been assumed to be 0. V under regular operation, other choice of these 
values are also possible. In this case, Eq. 10 is revised as 

V TH n = (Ctot/C g )Vth* - (Q F /C G ) - (C W /C G )V W - (C C /G G )V C (11) 

5 • ' • ' . : • - ■ • • • '' • 

where only the terms proportional to V w and W G are added. Thus, V™" is determined by only Q F as far as 
V w and V c are kept constant. 

' The value of Q F can be changed in the following manner as an example. V PP is defined as a program 
voltage which is higher than V D0 ; For example, V D o is set at 5 V, and V PP , at 10 V; Here, C w = C G = 
'0 (Cox/2) » C c is assumed for simplicity, which is easily achieved by the layout shown in Fig. 2(a). In the 
case of V c = 0 and V w - V G = V PP , Z = (V PP /2) = 5 V is obtained from Eq. 8 under the assumption of Q F 

- • ='o. ■ - • ..' , • • •• ' • ,: . a " ■ 

When the thickness of oxide film 205 is designated to be 50 A, the electric field of 10 MV/cm is applied 
to the oxide film. Then Fowter-Nordheim tunneling current flows: and electrons are injected into the FG from 

75 C; resulting in G F < 0. 

2 becomes smaller as Q F becomes negative as is apparent from Eq. 8, and therefore the tunneiing 
current decreases and finally is cut off when a certain number of electrons are injected. In order to correctly 
control the charge injection, the value of V w and V G can be changed byusing pulse. The absolute value of 
Q F is controlled by, for example, changing the number of pulses of constant width and height. 

20 The electron injection is also made by changing the pulse of V c : For example, after having set V w , V G 

and V c at V PPl only V c is decreased to 0 V by using pulses. The electron is injected and the amount of 
electron to be injected is controlled as well. The above-mentioned explanation refers to the case of Q F 
becoming negative where Vth" becomes larger according to Eqs. 10 and 11, namely, corresponding to the 
operation to weaken the strength of synapse coupling. . 

25 Next the operation to strengthen the synapse coupling is described. For this purpose, V w and V G are 

set at 0 and then V c is set to be V PP . Z becomes 0 V according to Eq. 8 and the election field of 10 MV/cm 
in the opposite direction this time is generated in the oxide film to make- electrons emit from FG to C by 
Fowler-Nordheim tunneling injection. As a result positive charges remain in FG and Q F becomes positive 
(Qf> 0). - - ■ : ■ - ; • 

30 Eqs. 10 and 11 show that the value of Vth" becomes larger and Eq. 7 shows that the value of W 
becomes larger. The condition corresponds to the operation to increase the synapse coupling strength. In 
order to increase the synapse coupling strength, it is also possible to increase only V c to V PP by using 
. pulses, while V w = V G = V c = 0 V holds. It is needless to say that the absolute value of Q F can be freely 
controlled by the pulse width, pulse height or pulse number. • .. •; 

35 Another essence of this method is to selectively change the strength of any synapse coupling. Four 
principal parts of synapses 212, 213, 214, 215, which are parts of NMOS having a floating gate, are 
arranged in matrix in Fig. 2(e). Gi and G 2 , corresponding to signal line 210, are installed in parallel with 
each other. W r and W 2 , corresponding to a signal line 211, are also installed in parallel. When one synapse 
e.g. 212 is to be weakened, the potential of V PP is applied to Gi and Wi , and 0 V to G 2 and W 2 . Here, V c is 

40 set at 0 V. As explained in Fig. 2(d), electrons are injected into the floating gate at 212 and the coupling 
strength becomes small. At synapse 215, V w = V G = 0 and therefore Z = 0 V, which causes no electron 
tunneling, and no change in the value of W. At synapses 213, 214, V G = V PPt V w = 0 or V G = 0, V w = 

, V PP . Then, Z - (1/4). V PP = 2.5 V, which indicates that the electric field applied to oxide film 205 is 5 
MV/cm, an half of that of synapse 212. Since the tunneling current changes exponentially with electric field 

45 strength, no tunneling current flows and therefore no change of Q F is observed at these synapses. 

In other words, only the synapse located at the intersection of two lines, both of which are in high, 
potential level V PP ,.cah have its coupling strength weakened. Thus, the coupling strength of the specific 
synapse can selectively be changed. In order to selectively increase the coupling strength, first V c = V PP 
and then Gi , G2, W1 and W 2 are all set to be V PP . The coupling strength of synapse 214 at the intersection' 

so is increased by reducing G2 and W 2 to 0 V. Although the explanation has been done for. the case of four 
synapses, it is apparent that the same selective change of coupling strength can be carried out for the case 
with more synapses in matrix arrangement. 

In Fig. 2(e), only NMOS transistor are depicted for simple explanation. In practice, PMOS and relating 
interconnects shown in Figs. 2(a) - 2(c) are attached to each NMOS transistor. 

55 The connection with neuron circuit 217 is explained in detail in the fourth embodiment. 

In. the . neural network of this embodiment, single synapse coupling is constructed with one NMOS 
transistor and one PMOS transistor, and therefore the occupied area of synapse coupling is very small, 
which, makes it possible to integrate synapse couplings in very high density. Furthermore, since the 
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coupling strength can be determined by the charges stored in the floating gate, the coupling strength can 
be freely changed and also stored. That is, nearly the same function as biological synapse is realized with 
only two elements. In the case of a large number of synapse couplings arranged in matrix configuration, 
any synapse can be chosen and modified to have any value of strength. In addition, no direct current needs. 
5 to flow to keep the output of synapse at constant value and therefore the power dissipation can be 
restricted to be very little, which is an ideal feature to construct ultra high integration neural network. 

In the prior art synapse coupling configuration shown in Figs. 13 arid 14, due to a large amount of . 
power dissipation and the necessity of a large number of elements to memorize the value of coupling 
strength, it is almost impossible to have high integration density of synapse couplings, while the highly 
. to integrated neural network is for the first time realized by the present invention, y 

In the embodiment 2, N^-type polysilicon is used as a material for electrodes 213, 217, WS12 for 211 
and Al for 210. The other materials can also be used as far as they can attain the similar functions. The 
materials and thickness of insulating films 204, 205, 208, 212 are not restricted to those of this embodiment. 
Furthermore the charges injection electrode 206 which is installed independently in this embodiment can 
rs also be formed in th extended part of the source electrode 213a or drain electrode 213b. This configuration 
. is preferable since the -interconnect to apply the potential to electrode can be omitted. And polysilicon 
electrode can also be substituted for N + layer. . 

The selective modification of coupling strength is carried out by means of combination of voltages 
applied to two electrodes 21 1 (W), 207 (G) in the embodiment 2. 21 1 (W) is the electrode for exclusive use, 
20 while 207 (G) acts also as the gate electrode of NMOS 203. Therefore, it is possible that another electrode 
exclusively used to modify the coupling strength is additionally formed in Fig. 2(d) and the. amount of 
charge to be injected to FG is controlled by voltages applied to two electrodes. 

. As a method for injecting charge, avalanche injection or hot electron injection is also used instead of 
Fower-Nordheim tunneling injection. 
25 Although a floating gate type MOS transistor is. used to make the. threshold of NMOS transistor variable 

in the embodiment 2. MNOS type device or non-volatile memory element with a ferroelectric film whose 
cross-sectional view is shown in Fig. 2(f) can be substituted. In Fig. 2(f), 216 denotes a P-type Si substrate, 
. 217, an S1O2 film of e.g. 50 A thick, 218, a ferroelectric film such as 3000 A thick PZT ( Pb( ZrxTh-x)^), 
219, an electrode made of e.g. Ti, and 220a, 220b, N + -type source and drain. Positive or negative pulse is ." 
30 applied to polarize the ferroelectric film and the threshold is controlled by the magnitude of polarization. 

As mentioned above, any method is adopted to make the threshold of NMOS transistor variable. In the 
case of the configuration shown in Fig. 2, it has already been mentioned that the threshold of V T H n .can be 
controlled by the charge in the floating gate. It is apparent from Eq. 11 that the threshold can also be 
controlled by setting V w and V c at appropriate values; that is, the synapse coupling is modified by 
.35 controlling the potential of V w and V c . 

In Fig. t(a)( embodiment 1) and Figs. 2(a) and 2(c) (embodiment 2), PMOS transistor 107, 202 is ;.■ 
inserted between NMOS 105, 201 and the ground (V ss ) line. The performance of PMOS transistor is 
explained below by referring to Fig. 1(b). 

In the case of V in = V DDl V out = V D0 - V TH n and the charge of C(V DD - Vth") is stored in the capacitor C. 
40 Then, if V in changes to 0 V, the PMOS transistor lets the charges in the capacitor C escape to the ground. 
Therefore, the PMOS transistor must be off when V in = V DD . and on when V jn = 0V. 

To shorten discharging time, the PMOS transistor should be designed so as to have. a large current 
capacity. For this purpose, a depletion type PMOSFET shown in e.g; Fig. 3(a) is used. The voltage applied 
to the gate of PMOS at the moment when V in changes from V DD to 0 V is expressed by: . 
.45 ' ■ ' - 

V gs » = - (V 0D - V TH n ) < 0 

Therefore, it is apparent from the comparison of Figs. 3(a) and 1(d) that more current flows in the transistor 
with Vth p > 0 than the transistor with Vth p ^ 0. 
so. Fig. 3(b) shows time response characteristics of the circuit shown in Fig. 1(b). The fall time is shortened 
by using a depletion type PMOS transistor although the rising characteristic is not improved because of 
being determined by the ON characteristic of NMOS transistor 105. The larger value of Vth p makes the fall 
time shorter. 

On the other„hand, when V in changes from 0 to V DD , NMOS transistors 105, 201 turn on under the 
55 condition of V in . £ Vth". Unless PMOS transistor is. off, direct current flows from V DD to V S s ( ground ) and 
power dissipation becomes large. In order to prevent the direct current from flowing, the threshold of 
depletion type PMOS must be designated as: 
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0 < V TH p < V T „ n (12) 

To make discharging time of capacitor C as short as possible and achieve the high speed operation of the 
circuit, the following condition should hold besides Vth p < Vjh", . . ' 

5 . - • " ■ • ; ' -' 

Vth p ^ V TH n (13) 

For PMOS transistors 107 t 207, an enhancement type PMOSFET with Vjtf < 0 can also be used. In 
this case, the time response characteristic of the circuit in Fig. 1(b> is shown in Fig. 3(c). The circuit has the 
same rising characteristic as that in Fig.. 3(b), but there is quite a few differences in the.falling characteristic. ' 
Namely, the output. voltage stops, changing at the point of V out = j Vth p | and maintained because the PMOS 
transistor turns off at the point. This voltage level actually decreases to OV after, a long time since the 
charges , in the capacity C escape through the leakage of PN junction or the subthreshold current of P- 
channel MOS transistor. 

Such synapse couplings can memorize the activated state for a while. Once the signal is inputted from . 
a fired neuron (i.e. V jn = V DD ), the voltage of V out , equal to |Vth p |, is held even after the output of the neuron 
falls in the low level. The holding time is controlled by e.g. connecting resistor R to PMOS transistor 107, 
202 in parallel and the output voltage is gradually approaches to 0 V on the basis of time constant of RC. 
The level of output voltage is controlled by Vf H p - 

The synapse coupling having a variety of characteristics can be realized by changing Vth p of PMOS 
transistor 107,202. The value of can be set at an appropriate value by channel ion implantaion in 
manufacturing process. The threshold Vth p can also be variable by adopting a floating gate type transistor 
structure and modifying charges in the floating gate, or by adopting the structure shown in Fig. 3(d) and 
modifying the value of V c or C c . Vth p is given by: 

Vth p = (Ctot/C g )Vth" - (Qp/Cg) - (C C /C G )V C (14) 

The value of C c .can be changed with the overlapping area between electrode 301 and floating gate 302. If 
the. overlapping area is appropriately designed at the stage of pattern layout, the manufacturing process . : 

30 becomes simple because ion implantation repeatedly carried out with various ion dose for each channel can 
be omitted. Furthermore, V TH P can be changed by the value of V c and therefore only specific synapse can 
. be maintained. at activated state for a limited time. . 

So far the PMOS transistor which shares the common gate electrode with NMOS transistor has been 
used as an element to discharge the charges in capacitor C. But the feature of the present invention can be 

35 available when, other types of load elements shown in. Figs. 3(e), 3(f) and. 3(g) are used. In these figure, only 
the part corresponding to Fig. 1(b) is shown. Namely, a resistor 303, a depletion type PMOS 304 with the 
gate connected to the source, or an enhancement type NMOS 305 with the gate connected to the drain are ; 
used in these figure in place of PMOS transistor. Furthermore, other load elements such as an enhance- 
ment type PMOS in which the gate is connected to the drain/ a depletion type, NMOS in which the gate is 

40 connected to source, or an MOS transistor in which a certain voltage is applied to the gate are used. 
Although the feature of low power dissipation is lost in these cases since direct current flows to hold the 
level of.V ou( , the power dissipation can be reduced, by using a load with large effective resistance. These 
- circuits are combined with e.g. variable threshold NMOS transistor 201 and used in the same manner as 
shown in the embodiment s, which can provide a synapse with variable coupling strength and memory 

45 function. This feature can never be realized by the prior arts shown in Figs. 14(a) and 14(b). 

(Embodiment3) - 

The third embodiment of this invention is described by referring to Fig. 4. The symbol of Fig. 4 has the 
so same meanings as. in Figs. 2(a) - 2(d). 

401, 402 are respectively NMOS and PMOS. transistors, and have common floating electrode (FG) 403; 
404 is a gate electrode capacitively coupled with FG through an insulating film such as Si0 2 film, and acts 
as a common gate, electrode (G) of NMOS 401 and PMOS 402. 405 and 406 are control gates (W) for 
adjusting synapse coupling and a charge injection electrode' (C) similar to 211 and 206 in Fig. 2(c), 
55 respectively. The other structure is the same as that of the second embodiment; 407 denotes a signal line 
which transfers the output signal of a neuron at the previous stage and 408 denotes an interconnect to send 
the output of synapse to one of the input terminals of neuron 409 at the next stage. 
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In order to explain the operation of this embodiment, the part of synapse coupling is extracted from Fig, 
4(a). and shown in Fig.. 4(b). The voltage applied to electrodes G, W, and C are V G( V w and V c , respectively, . 
and the potential of silicon substrate is Q V, which yields the potential Z of FG as: . 

5 2 = (C G V G + C W V W + C C V C +' Qf)/C T ot 

Ctot = C ox n + C ox p + C G > C w + C c (15) • 

The threshold values at which inversion layer is formrd, as seen from NMOS and PMOS are denoted by 
Vth"* and V™^, respectively. Then the threshold values V-th", V^p seen from common gate electrode G of 
. ro NMOS and PMOS are given by: 

Vth* = (CT0T/C G )V TH n * - (Q F /G G ) - <C W /C G )V W - (C C /C G )V C (16) 

VthP = (Ctot/CgJVth^ - (Qf=/C g ) - (Cw/C G )V W - (C c /C G )y c (17) 

Certain constant potential is applied to V w and V c except while synapse coupling strength is being changed. 
For example, in the case of V w = V c = 0, Eqs. 16 and 17 are revised to Eqs. 16' and 17', 

Vth" = (Ctot/C g )Vth^ - (Qf/C g ) (16') V. ' 

• Vt„p = (Ctot/CgFth^ - (Qf/C g ) (17') , 

Both V-m" and V TH P can be changed by Q F and therefore, the synapse coupling strength can be changed 
according to Eq. 7. 
25 From Eqs. 16 and 17, 

Vth" - Vr„P = (Ctot/CgHVth 0 * - V TH p *) (18) 

where Ctot. C Gl Vth^ and Vth^ are determined by manufacturing process and therefore cannot be changed 
30 after the element is fabricated. In other words, Vth" - Vth p is always constant and does not change even if 

the synapse coupling strength is changed. 

This fact has a very important meaning as follows. It was described in the embodiment 2 using Fig. 3(a) 

and 3(b) that both using a depletion type PMOS transistor ( Vth p > 0) and increasing Vth p as large as 

possible are effective in improving the falling characteristic of synapse. /; 
35 In order to prevent large power dissipation due to the flow of direct current, the condition expressed by 

Eq. 12 is required. 

Vth p < Vt„" (12) ' ] 

40 In the embodiment 2, only the threshold of NMOS transistor 201 is variable. Namely, Vth" changes. while 

Vth p is kept constant. The condition of Eq.1 2 restricts the margin of V TH P . For example, when the value of 

Vth" Is changed from 0 V to V D0 (corresponds to the change of W from 1 to 0 ), Vth p —> 0 is inevitable, to 

attain .the condition of Eq. 12. 

On the other hand,, it is apparent from Eqs. 16 and 17 that V TH n and Vth p change together with each 
45 other and the difference is always kept constant, indicating that Eq. 12 always holds. Namely, by setting 

Vth p and Vth" as V TH P Vth" and Vth p < Vth" in the manufacturing process, it becomes possible to realize . 

the optimum condition where lower power dissipation and shorter fall time can be achieved.. 

The third embodiment is similar to the embodiment s except that NMOS and PMOS share the floating 

gate in this embodiment. Therefore, the synapse coupling strength can be changed in the same manner. 
50 • . • - 

(Embodiment 4) . . • „ • 

The fourth embodiment is explained using Fig. 5. Fig. 5(a) represents a layout of principal part of neural 
network which is composed of one synapse coupling and one neuron 502. 
55 This circuit is constructed by CMOS process using . bilayer polysilicon and bilayer Al interconnect 

technology. The materials used in Fig. 5(a) are shown in Fig. 5(b). Al interconnects running in the X 
direction are the interconnects of the first layer and those in the Y direction are the interconnects of the 
second layer. As for.V DO , V ss and V c , Al interconnects are omitted in order to easily understand the layout. 
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. The potential is applied through, for example, the Al intercohnects of the first layer. 

Figs. 5(c) and 5(d) are cross-sectional views along X-X' and Y-Y' lines of Fig. 5(a), respectively. 503, 
504 are NMOS and PMOS transistors, respectively, and 505 is a common floating gate (FG) to both, 
transistors. 506, 507 and 508 are a gate electrode (G) common for both NMOS and PMOS, a control gate 

s for changing synapse coupling (W) and a charge injection electrode (C).respectively. Here, concrete pattern 
of the circuit which has the same function as that shown in Fig. 4(a) is expressed 

In this embodiment, charge injection electrode 508 is formed with polysiiicon of the second layer over 
polysilicon electrode 505 through e.g. about 70 A thick thermal oxidation film 509 (see Fig. 5(c)). It is also 
possible to use N + diffusion layer as shown in the embodiment 2. 

70 ;W 507 is connected to Al interconnect 511 of the second liayer through contact-hole 510. G 506 is. 
connected to signal line 512 which is. connected to the output terminal of neuron in the same manner as 
103 in Fig. 1(a) and 2.10 in Fig. 2(a). y 

513 is capacitively coupled with floating gate (FG) 515 through insulating film 514, and 515 is the . 
floating gate of both NMOS 516 and PMOS 517 transistors, constructing CMOS neuron gate 519, which. 

75 corresponds to Fig.. 12(a). and 1210 in Fig. 12(b). The output is inputted through Al interconnect 520 to 
CMOS inverter 521 , the output of which appears in Al interconnect 522 of the first layer. Here, the output is 
connected to the Al interconnect 524 of the second layer through through-hole 523, and connected' to Al 
interconnect 525 which is parallel with 512. The interconnect 524 expands downwards as shown by 524b 
which acts as an output line to the neuron in the next layer. The detail is explained in the embodiment 5. 

20 A signal line 525 forms a signal line to feed back the output of neuron 502 to the input terminal of the 

same neuron and therefore is connected to e.g. the neuron 502 through a synapse circuit such as 501. In., 
the figure. 526, 527 and 528 denote P-type Si substrate, N-well and field oxide film, respectively. As 
mentioned, above, the most important function of neural network including feed-back function can be 
constructed on a very small chip area by this embodiment. This embodiment is easily applied to a neural. 

25 network composed of a large number of neurons. 

(Embodiment 5) 

Fig. 6(a) is a diagram to explain the fifth embodiment of the invention, f,\ ?i 2 , ™,» t n denote a group of n. 
30 neurons in the first layer, each of which has a circuit similar to 502 in Fig. 5(a). p n \ vn 2 , ?u n and v m \ v Ui 2 , 
V m n are groups of n neurons in the second and third layers, respectively. Each neuron has structure similar 
to 502. O, 1 , Oi 2 , 0" are output lines from neurons in the first layer and corresponds to signal line 512 in 
Fig. 5(a).- ' . - • ■■ ■ : - 

In 1 , 'In 2 . "Jn" are input lines of neuron group in the second layer, and correspond to floating gate 515 in 
35 Fig. 5(a) .On 1 , 0» 2 , "\ 0» n are output lines of neuron group in the second layer, and some of them are 
connected to input tines of neuron group in the third layer through interconnects such as 601a, 601b, or 
connected through interconnects 602a, 602b to interconnects such as 603a, 603b which are parallel with the 
output lines of the first layer neuron group to form feed-back loop. . . 

601a, 602a and 603a corresponds to interconnects 524b, 524 and 525. The synapse coupling circuits 
40 such as 604a, 604b correspond to e.g. 501 in Fig. 5(a). 

This embodiment shows a layout of neural network consisting of neuron groups of three layers. It is 
apparent that the present invention makes possible to construct neural network by regularly arranging the 
circuit in two dimension, which is very suitable for LSI.- . 

. Fig. 6(a) is simplified and then shown in Fig. 6(b). y t (n) in 605 denotes a group of neurons in the. first 
45 layer where n means that the neuron group is composed of n neurons. S(2n,n) in 606 is called synapse 
matrix and denotes a group of synapse arranged in matrix which combines 2h outputs ( the sum of n 
outputs of the first layer and n outputs feed backed from the second layer) and n inputs to the second 
layer. The arrow 607 means the flow of signals and the arrow 608 means that n outputs are feed-backed. 
By using such notation, more complicated neural network can be expressed simply. 
5 b . •• . 

. (Embodiment 6) 

; Fig. 7 shows the sixth embodiment of the invention where a four-layer neural network is expressed by. 
using the notation of Fig. 6(b). Here, l(n) denotes a input buffer layer composed, of n amplifiers as shown in 
55 Fig". 7(b) which output the potential level of 0 V or V DD for each of binary input signals h, h, "'. In of 0 or 1. 

As is apparent from Fig. 7(a), four layer neural network having feed-back function is realized by two- 
dimensional, regular arrangement. . 
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The human brain is said to be composed of six layers of neuron groups. The neural network with more 
layers can easily be constructed by the repetitions of the; same plane arrangement. That is, the semicon- 
ductor device of the present invention have very advantageous feature for realizing a neuron computer. 

.. 5 (Embodiment 7) 

Fig. 8 is a diagram showing the seventh embodiment which is similar to Fig. 4(a) except that the drain 
of NMOS 401 is connected to OV, the drain of PMOS 402 to -V D0 and G to signal line 801. 

Fig. 8(b) shows the relationship between V in ( potential of 404) and V out ( potential of 408), where V™" is 
w a threshold seen from the gate electrode 404 of NMOS transistor 401 . Therefore, V oul = 0 when V ifl = V DD , 
and V ou , = Vrn" when V in = 0. From the figure, V in is equal to the potential of signal line 801, which is 
equal to the inverted potential of that of signal line 407. Therefore, V jn '=- 0 when the neuron in the previous 
stage is fired, and V jn = V DD when the neuron is not fired, indicating that the synapse transmits negative 
output of -Vth" to the neuron at the next stage when the neuron at the previous stage gets fired. That is, the 
75 synapse, an inhibitory synapse, performs so as to restrain the neuron at the next stage from firing. . 

As mentioned above, an inhibitory of organism can easily constructed according to . the present 
invention. Being expressed by -Vth", An inhibitor level is controlled by changing the amount of charge in 
the floating gate. 

In all embodiment of this invention, the explanation has been made for the case where interconnects 
20 such as 103, 210, 407 etc are connected to the output of neuron; however, this invention are not restricted 
to such cases. For example, this invention is also available for the , case of the interconnects being 
connected to the output of input buffer. It is also possible that output data of neuron are supplied to these 
interconnects . through a pass transistor after being latched in e.g. flip-flop or supplied through an 
appropriate amplifier. 

25 ■ ' • ' - ' • • • • . ;■"'/-. ' - • • • '. 

Industrial applicability 

As mentioned above, the semiconductor device of the present invention realizes a neural network 
having nearly the same function as human brain and low power dissipation characteristic by a small number 
30 of elements. The semiconductor device can be regarded as the most appropriate device to realize a neuron 
computer since complicated neural network is constructed by regularly arranging elements in matrix. 

Claims 

A semiconductor device comprising a first semiconductor region on. a substrate, first source and first 
drain regions of opposite conductivity type to that of said first semiconductor region formed in the said 
first semiconductor region, a first gate electrode floating in potential formed over the region separating 
said first source and first drain regions through a first insulating film, a plurality of second gate 
electrodes capacitively coupled with said first electrode through a second insulating film, and a first 
MOS type transistor, .•••'•< 

wherein the source electrode of said first MOS type transistor is connected to one of said second gate , 
electrodes and at least the gate or the drain electrode of said first MQS type transistor is connected to 
a first interconnect which transfers two-level voltage signal of high or low level. 

The semiconductor device according to claim 1, wherein said first MOS type transistor has a gate- 
structure to change its threshold to a prescribed value. 

The semiconductor device according to claim 2, wherein said first MOS type transistor has a floating 
gate. ■ . 

The semiconductor device according to claim 2, wherein said first MOS type transistor is an MNOS ( 
Metal - Nitride - Oxide - Semiconductor) type transistor. 

The semiconductor device according to one of claims 1 to 4, wherein said first MOS type transistor is 
N-channel type, the source electrode of which is connected to A low level. power supply line through a 
second MOS type transistor of P-channel type and the gate electrodes of said first and second MOS 
type transistors are connected to said first interconnect. 

. • . /.• 13 
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6. The semiconductor device according to claim 5, wherein said second MOS type transistor is an 
enhancement type. 

7. The semiconductor device according to claim 5 t . wherein the threshold of said second MOS type 
5 transistor is nearly 0 V, 

8. The semiconductor device according to claims 5, wherein said second MOS type transistor is a 
depletion type. 

io 9. The semiconductor device according to one of claims 3, 5, 6, 7, and 8; comprising at least one third 
gate electrode capacitively coupled with said floating gate of said first MOS transistor through a third 
insulating film, and a charge injection electrode opposing to said floating gate through a fourth 
insulating film, 

wherein charge transfer occurs through said fourth insulating film between said floating gate and said 
75 charge injection electrode by applying, prescribed potential to said third gate electrode and said charge 

injection electrode. 

10. The semiconductor device according to claim 3 or 5, comprising said second MOS type transistor 
having a floating gate electrically connected to the floating gate of said first MOS type transistor, at 

20 least one third gate electrode capacitively coupled with said floating gate through a third insulating, film, v. 

and a charge injection electrode opposing to said floating gate through a fourth insulating film, 
wherein charge transfer occurs through said fourth insulating film between said floating gate and said 
charge injection electrode by applying prescribed potential to said third gate electrode and said charge 
injection electrode. 

25 ' 

11. The semiconductor device according to one of claims 1 to 10, wherein a plurality of said first 
interconnects are arranged in parallel with each other, and a plurality of said first gate electrodes are 
arranged in parallel with each other and perpendicular to said first interconnects. 

30 12. The semiconductor device according to claims 1, comprising first, second, and third power supply lines 
for supplying high level, medium level and low level voltages, respectively, and said first MOS type 
transistor being N-channel type, 

wherein said first interconnect transfers first signal with two potential levels of high and low levels which 
correspond to the potential of said first and second power supply lines, respectively, the drain of said 
35 first MOS type transistor is connected to said second power supply line, and the inversion of said first 
signal is inputted to the gate electrode of said first MOS type transistor. 

13. The semiconductor device according to claim 12, wherein said first MOS transistor has a floating gaite. 

40 14. The semiconductor device according to claim 12 or 13, wherein the source of said first MOS type 
transistor is connected to said third power supply line through a P-channel MOS type transistor. - 
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